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A CONGENERIC MODEL FOR PLATONIC TRUE SCORES 
Charles E. Nerts ^ Robert L. Lirm^ and Karl j6'reskog 

Abstract 

To resolve recent controversy beWeen Klein and Cleary and Le\^, 
a model for dicb jtomous congeneric items is presented w“hich has mean 
errors of zero^ iichotomous true scores that are uncorrelated with errors, 
and errors that are mutually uncorrelated. 
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A CONGEMIRIC MODEL FOR PLATONIC TRUE SCORES 
Charles E. Werts^ Robert L. Linn, and Karl J6Veskog 

In a discussion of platonic true scores, Klein and Cleary (1967) sT:ate 

that the use of platonic true scores makes the assumptions of classical test 

theory generally untenable. They illusti 2 their argument vith dichotomous 

items and a dichotomous trn.e score and show that: ^^The classical test 

2 2 2 

theory formiilation o* = cr^ + cr-p, , can only be true if the mean error is 
not zero” (Klein & Cleary, I 967 , p- 78)* This statement is based on the 
following definitions of obser\?"ed (x), true (T), and error (e) scores: 

1 1 if phenomenon is present | 



\o i 



if phenomenon is absent 



X = 



I 1 if phenomenon is rated as present 
I 0 if phenomenon is rated as absent 



and E = X * T . Klein and Cleary go on to consider two parallel dichotomous 
items , X^ and X^ , and show that the covariance between E^ and is 

positive when the errors, E^ and E^ ^ have zero means. With correlatec"^ 
error scores, the correlation between two parallel itcin^ -esC Liiates the 
item reliabilities. In response. Levy (1969) argued that the classical 
assumptions can be shown to hold for a dichotomous item if 



X = 



I a if phenomenon is rated as present | 



b if phenomenon is rated as absent 



I ' 



true scores (T) are defined as above and E - X - T as before. This modifi- 
cation will indeed make it possible for the mean error to be zero and the 
covariance between T and E to be zero. As Klein and Cleary (1969) note. 



however. Levy does not provide a means of solving for 



and 



without 
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knowledge of T • In any practical application^ T 'would be unknovm and 
therefore ”a^^ and would be -imknown, Also^ no way of obtaining item 

reliabilities is presented. The piurpose of this paper is to provide an 
alternative formulation which allows for the model parameters to be deter- 
mined given the structural specification of zero mean error and no corre- 
lation among errors for different items or between errors and true scores. 
Our approach is drawn from latent structure analysis (Anderson, 1959) fo^r 
the special case of dichotomous latent variables. 

Ic A Congeneric Model for Dichotomous Items 



The equation for congeneric tests is given by JSreskog ( 1968 , 1970^ 
1971 ) as 



To illustraur’ application of this definition to the case in which 1 
and T^ ar-- both dichotomous (scored 1, O), consider the case of thrse 
items, which is the minimum number of items required to identify model 
parameters uniquely, given experimentally independent measures. The 
equations aie 




(1) 



where T^ is the true score for person i , 

X. . is the observed score on item j for person i , 
^ J 

is the slope of the ^ T^ rr rrv^tijio^ li.. 

I. is the intercept of this regression line, and 
J 

E. . is the error for person i on item j . 
ij 




(la) 




(lb) 






(ic) 
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where the E 's are mutually uncorrelated and are uncorrelated vrith T . 
In the case of dichotomous variables 

p{x. = 1, T = 1) - p{x. = l)p{T = Ij 
V ' pfT ■ lip f T 



= 0 ] 



and 
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I. = p{x. = 1} - B p(t = 1} = p{x = i|t = 0} . 

J j u u 

This model is somewhat more complicated than, the model considered by 

Klein and Cleary (196T) where X = T + E with X , T , and E all taking 

values of 0 or 1. In essence, the congeneric model is equivalent to the 

model suggested by Levy (1969) if his "a" and "b" are allowed to vary 

from item to item. For a given item, equal (l - )/b^^ , 

"b . " would equal -I./b , and Levy's error would equal the error of 

tJ J J -E 



equations 1, 2^ or 5 divided by B. 



To illustrate the point that the 



CO ;enex*ic model doe3 allow for the traditional psychometric assumptions 

in the dichotomous case^ consider the following example constructed using 

the equations provided by Anderson (1959^ sec. 

1. The 0. (proportion of false negatives, i.e., P(X = oIt = l3 = 
3 3 

p{X. = 0,T - l] V P^ ), (proportion of false positives, i.e., 

J -E I 

p{x. = i|t = o] •“ p{x. = 1,T = o) V (l - P„)) , and P_ (the true pro- 
3 3 11 

portion pCT = l] ) are given as: 

9^ = .50 , = .kO , 9^ = .10 ■, 



0 ^ = .10 , 



= .50 , = .50 



Bm = . 60 , and — 1 - P,p — . 4-0 

2. The expected marginal distributions (P. = Prob (X = l}) are 

0 3 

P. = (1 - 0.)P^ + , i.e., P^ = .4-6 , Pg = .56 , and = .66 . 



-4- 



3. The expected Joint probabilities for pairs of items, ^jj' ~ 

Prob (Xj = 1, X^, = 1} = (1 - 0^.)(1 - ^ 

= -272 , P^j = .390 , and P^^ = .384. 

4. The expected joint probability for three items, P. .tt = 

J J <3 

Prob (x = 1, X ,= 1, X , , = l) = (1 - 0 )(1 - 0 ,)(1 - e.,,)P^ + o 9 ,,G) 

(J = 1 = j' = 1 = <]■") is Pj_2^ = .2328 . 

5* The regression weights (B.. =1-0. - <P .) axe B ^ = *60 , 

t]t d J li 

= .10 , and = .60 , 

6. The intercepts (l^ = = ,10 , = .50 , 



jT T 



and possible events for combinations of the three items and 

the proportion of people in each event are shown in Table 1. The means of 
the errors are zero, the true score is uncorrelated with the errors and the 
errors are uncorrelated with each other. 



Insert Table 1 about here 



II. Identification 

In an actual problem the situation would be reversed from the example 

shown in section I, i.e., the probabilities ^1" ^ 2 ’ ^ 3 ’ ^ 12 - ^ 13 ’ ^ 23 ’ 
and correspond to observed scores, and it would be desirable to 

identify the seven parameters, 0^, 0^, 0^, 4^^, 4^^, 4)^, and P^ . In 
principle, one could solve the seven equations for this purpose; 





= (1 - 


■ ‘’iK * 


■©- 

H 

V. 


(2a) 


^2 


= (1 - 






(2b) 


^3 


= (1 - 


■ * 


‘*’ 3 ^: ^ 


(2c) 
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Pl2 = (1 - 03_)(1 - ^ 

^13 " ‘*’l‘^3®T ^ 

^23 ' (1 - « 2)(1 - e ,)?! "• » 2 ® jS : > ( 2 f ) 

’’123 “ ' ®3^^T + 



The Rolution to these equations is facilitated by noting that in the congeneric 
model the expected covariance (C..^) between two items is given by 



where is the variance of T • Translating into probabilities : 

‘"■jj' ■ Vo'> = - "d - - ®d- - • (5) 

This means that 

^12 = ^12 " ^ 1^2 = (1 - - *i)(l - ^2 " ^2 ^^tS? ’ 

^13 = '’13 - 

^23 " ^23 •■ ^2^3 = (1 - ©2 " ' ®3 ' ‘^3^^tS: • 



These equations can be solved for 

b - Pg - 'tg) PjQ^ 

(1 - - *3)^ PA 



^ 12^13 2 


(5a) 


c c 




12 23 2 

C,f = WA ^ 

15 


(5h) 


^13^23 2 

c^2 ~ ®3 t^tS: • 


(5c) 



o 
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The triple covariance is defined (Boudon, 1968, p. 226) as the 

expectation of the products of the deviations of all three variables 
simultaneously, which is equal in the dichotomous case to C. 



123 ^ -^123 



h(''23 ' - V 3 ) - Pj(Pi2 - - Pj^PgPj . 

Using equations (2a, b, c, d, e, f ) equation (6) may be translated to 

2 2 

^123 “ equations (5a, b, c) we obtain 



( 6 ) 



"125 






these equations to our example, 

1. Compute covariances by equations (ij-a, b, c): 

^12 ~ ^ = .086V , aiid Cgj = *Ol44 

2» Using equation (6) compute ^^23 ~ “.OOI728 . 

5* From equation (7), 



(7) 



= -.4082 = 



"^*^ 12 ^ 3^25 






4. 

5- 



Solving for = 1 _ ^e obtain = .60 . 

From equations (5a, b, c) and substituting in this value of P^ , 

J| ~ • ^ , 

®2T ~ ^ 

®3T ~ • 

It can be shown (equations 2a, b, c) that 4> = p - r P ner- 

3 j jT T 

mitting calculation of <t> = I 

J 3 



O 
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7. Since 0. = 1 - B._ - , 

J -JT j " 

0 ^ = .50 , 

0 „ = ,.10 . 

5 

O 

8 . Item reliabilities R.. are R. . = B.„P„Q„/P Q. , i.e., 

JJ JJ JT ■ 

R 3 _j_ = .3i)-78 , 

^22 " ^ 

R 33 = -5850 . 

In the case of three congeneric items the model 'parameters are 

identified, i.e., there are seven equations in seven -unknowns, which is the 

reason that the parameters may be obtained as an exact function of the 

observed probabilities. In the case of over identified models one of the 

estimating procedures discussed by Anderson (l959) can be used. One 

2 

procedure minimizes a X itinction of the observed probabilities (Pq) 
the expected probabilities (Pg) generated as a function of the parameter 
estimates (Cochran, 1968; Mote & Anderson, 1965). In the general case of 

T 

J items there will be (2 - l) independent observed probabilities in the 

cross-tabulation table from -which (2J + l) parameters are to be estimated. 
In the special case of two items of equal acc-uracy the reliability is the 
correlation between these items, b'lt the model parameters cannot be identified 
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(Cochran, I968, sec. 6) since = 1, = 0 } = = 0, = 1 } , 

i.e.^ there are only two independent probabilities to estimate three 
parameters . 

Ill* Variations 

It is sometimes the case that three items with errors that are imcorre- 
lated with true scores or errors of other items are available but one of 
these measures another variable, i.e.. 






^2 “ ^ 2 '^! ^2 ^2 ^ 



( 8 ) 



X3 = B3T2 + I3 + E3 
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In econometrics X^ is called an "instrumental" variable (Johnston, 1963 , 



p. 165). The equation for X^ can be transformed into 



where 



* * * 

+ I^ + , 



^3 " ^T^T^^3 



(8a) 



is identified but B™ ™ and B, are not. In the case of dichotomous 

2 1 ^ 

variables, therefore, the true proportion P™ may be estimated as shown 

1 



in section II by treating as a congeneric measure of 



and 






1 



p ) , where 9 = p[t = o|T-, = l} and 

1 1 



^iji “ ^^"^2 “ = o} . The validity of such an analysis is dependent on 
the correctness of the independence assumption. 

The above analysis can be extended to the case of four items with 
mutually uncorrelated errors and no correlation between error and true 
scores, two of each measuring different variables: 
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= BjT^ + I3 + ^ 



X4 = + I3 + . 



( 9 ) 



Following the above line of reasoning all parameters in this model (P^p y 

1 

p(T^ = l.T^ == 1};. Qy 4)^, 4 )^ ^ and may be 

identified. There are 15 independent proportions in the cross -tabilLation 

2 

table ^ so that the minimized X woiHd have four degrees of freedom* In 

principle^ a measure of the tenability of certain assumptions is obtained 

2 

from changes in the X . For example^ if it were desired to test the 
hypothesis that and were of equal accuracy^ increases in the 

total X (with two degrees of freedom)^ resulting from setting 0^ = 0^ 
and “ ^2 ^ would be an indicator of the tenability of this hypothesis. 
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Footnotes 

^The research reported herein vas performed pior-suant to Grant No. 

0EG-2-700035(509) with the United States Department of Health, Education, 

and Welfare and the Office of Education* 

2 

The true scores are not independent of the 5^rror scoz^eBS or errors of 
each other, as is assumed in Anders on (1959) derzivairdi ons however, for 
oior purposes the assumption that these variables micorz^elated yields 

the same formulas. 
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Table 1 

Possible Events for Three Congeneric Dichotomous Items 



Proportion 
of People 


T 


^1 


^2 






^2 


^3 


.2268 


1 


1 


1 


1 


.3 


.4 


.1 


.0252 


1 


1 


1 


0 


.3 


.4 


-.9 


.1512 


1 


1 


0 


1 


.3 


-.6 


.1 


.0168 


1 


1 


0 


0 


.3 


-.6 


-.9 


.0972 


1 


0 


1 


1 


-.7 


.4 


.1 


.0108 


1 


0 


1 


0 


-.7 


.4 


-.9 


.06i^8 


1 


0 


0 


1 


-.7 


-.6 


.1 


.0072 


1 


0 


0 


0 


-.7 


-.6 


-.9 


.0060 


0 


1 


1 


1 


.9 


.5 


.7 


.OlJlO 


0 


1 


1 


0 


.9 


.5 


-.3 


.0060 


0 


1 


0 


1 


.9 


-.5 


.7 


.OlJlO 


0 


1 


0 


0 


.9 


-.5 


-.3 


. o^ho 


0 


0 


1 


1 


-.1 


• 5 


.7 


.1260 


0 


0 


1 


0 


-.1 


.5 


-.3 


. 05 i^-o 


0 


0 


0 


1 


-.1 


-.5 


.7 


.1260 


0 


0 


0 


0 


-.1 


-.5 


-.3 
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